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Abstract 

The problem of dynamic estimation of all parameters of a model representing chaotic and hy- 
perchaotic systems using information from a scalar measured output is solved. The variational 
calculus based method is robust in the presence of noise, enables online estimation of the parame- 
ters and is also able to rapidly track changes in operating parameters of the experimental system. 
The method is demonstrated using the Lorenz, Rossler chaos and hyperchaos models. Its possible 
application in decoding communications using chaos is discussed. 

PACS numbers: 05.45.-a,43.72.+q,47.52.+j 
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Synchronization of uni-directionally coupled chaotic systems has been a subject of great 
interest for over a decade [1, 2, 3, 4]. The interest in understanding the synchronization 
characteristics of chaotic systems stems from its potential applications in a variety of areas, 
for e.g. in optics, communications and time series analysis of chaotic systems. An important 
issue in time series analysis of chaotic systems is the estimation of all parameters using 
information from a scalar measured output. This information, can in turn be used to 
estimate all the unmeasured system states, provided the model is known. 

In general there are three key issues in parameter estimation of dynamical systems. 
Firstly, the method has to be robust in the presence of noise. Secondly, the method must 
allow estimation of all parameters using any conveniently measurable output from the sys- 
tem. Thirdly, it must be able to rapidly track changes in the operating parameters of the 
experimental system. 

Current parameter estimation techniques can be broadly classified as online and off-line 
strategies. The online, e.g. adaptive control approach [5], though simple to implement, 
has been demonstrated to be unsuitable for estimation of multiple parameters (e.g. for the 
Rossler system). In contrast, off-line, e.g. autosynchronization [6] and error minimization 
[7, 8] schemes have been demonstrated to be able to estimate all parameters. The former 
is a geometric approach where the optimal vector fields governing temporal evolution of the 
parameters are obtained using a linearization based numerical procedure. Using the error 
minimization approach, Goodwin et al. have shown that all parameters can be estimated 
by using a scalar measurable output (not necessarily corresponding to one of the state space 
variables) of chaotic and hyperchaotic systems [8] . 

For systems with multiple parameters, the least squares error function possesses several 
minima [8]. This can lead to an erroneous estimate of parameters owing to convergence 
at one of the local minima. Moreover, in practice, it may not be always possible to pos- 
sess information of the time at which parameter changes in the experimental system occur. 
For online schemes, a lack of this information results in erroneous estimates of the deter- 
mined parameters. Off-line schemes cannot be used in this situation, since there is no way 
to incorporate the effect of parameter changes in the least squares minimization method 
traditionally employed for parameter estimation. 

In this Report, the least squares approach is used to develop a general and robust method 
for deriving the dynamical system governing the evolution of all parameters of a chaotic 
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system. The technique is demonstrated using simulated experimental data from the Lorenz, 
Rossler chaos and Rossler hyperchaos systems. The advantages of the method are its abihty 
to: (a) estimate all parameters in an online setting, (b) respond to unknown changes in 

parameters of the experimental system, and (c) converge to the 'true' estimates of the 
parameters. Each of these is a distinct improvement over capabilities of the existing methods. 
We begin by briefly describing the set up of the parameter estimation problem. Let 

x = f(x,p) (1) 

represent the experimental dynamical system with state variables x e R", whose parameters 
p G R"* are to be estimated. The overdot indicates differentiation with respect to time t. 
The only information available from this experimental system is (i) the functional form of 
the model and (ii) a scalar time series given by an observable s(x). The model is given by 
the following equation 

y = g(y,q) (2) 

where y G R" and q G R™, and the functional form of g is identical to that of f in (1). 
We assume that there exists an uni- directional coupling scheme using the available scalar 
output of the experimental system (1) which enables asymptotic synchronization of the model 
system (2) with the experimental system (1), i.e. y — > x as t ^ oo, if q^ — p. The coupling 
can either be a drive/response couphng scheme, e.g. the Pecora-CarroU scheme [1] or a 
feedback coupling scheme [9]. The conditions which enable synchronization of the model 
system (2) with the experimental system (1) arc well known. In most cases, synchronization 
is guaranteed if all conditional Lyapunov exponents of the error system e = x— y constructed 
using Eqs.(l) and (2) are negative [10]. Techniques are now available which enable design 
of an uni-directional scheme which guarantees synchronization [11]. 

For the sake of conciseness, we only consider feedback couphng in this report. The general 
representation of this scheme is given by 

y = g(y,q)-BK^(s(y)-s(x)) (3) 

where B is a constant vector and K is the gain vector. The scheme (3) has been previously 
used for achieving identical synchronization in a hyperchaotic system [9] . 

We now develop the main theme of this Report which can be defined as: "Develop 
a formalism for constructing a system of differential equations governing the evolution of 
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the model system parameters q such that (y, q) — > (x, p) as f — > oo." Our objective will 
be to design a parameter evolution scheme that asymptotically drives the measured error 
s(y) — s(x) to zero, and thereby yields (y, q) — > (x, p) as i — >^ oo. The starting point is the 
following minimization problem 

G(q) = min[(5(y) - ^(x))^] (4) 

We note that an inability to correctly estimate the initial conditions of the state variables 
and/or parameters could result in large errors during the initial stage of evolution of the 

model system. Our goal, reflected in the choice of the cost function (4), is to force the model 
output s(y) to asymptotically synchronize with the experimental output s(x). The mini- 
mization problem (4) is studied as the following equivalent system of differential equations 

The equilibrium state of the system (5) is typically attained when the synchronization con- 
dition is satisfied, i.e. when s(y) = s(x). This ensures that the parameter estimates attain 
their true values. In contrast, convergence to the true parameters is not guaranteed in the 
error minimization approach since the least squares cost function has several local minima 
[8]. A knowledge of the variational derivatives dyi/dqj for i = 1, ■ • ■ ,n and j — 1, ■ • ■ , m 
is needed for solving this system of equations. Since the functional form of the model is 
known, these derivatives are given by (using Eq. (3)) 

^ dgi dyk ^ dgj ^^^^ ^^(y) 

i^'i-,--- ,n; j ^l,--- ,m (6) 

Formulation of Eqs. (4)-(5) and using Eq. (6) to solve Eq. (5) are the key steps in the 
proposed procedure for estimating all parameters of a chaotic/hyperchaotic system. The 
method consists of solving (i) the experimental system (1) (when real experimental data is 

not available), (ii) the model system (3), (iii) the equations 

(Ij = ~^iQ^. = -2ej(^(y) - s(x))-^, j = 1, ■ • ■ , m (7) 

governing evolution of the parameters, and (iv) the equations corresponding to the evolution 
of the variational derivatives Eq. (6). The vector of additional parameters e is needed for 
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guaranteeing stability of the overall system and it also controls the rate of synchronization. 
When the actual scalar measured output from an experiment is available, an extended system 
comprising of n + m + nm equations needs to be solved in order to estimate m parameters 
of a n dimensional system. The condition for convergence of the procedure is that the real 
part of the eigenvalues of the Jacobian matrix or the conditional Lyapunov exponents of the 
extended system formed using Eqs. (3) and (7) are all less than zero [6]. 

Our first example is the Lorenz system. We demonstrate the method when the scalar 
observable is X2- The simulated experimental and model systems are respectively given by 
the following equations 

ii = Pi{x2-xi) yi = qi{y2-yi) 

X2 = P2X1 - X2- xxx-i y2 = q2yi - 1/2 - I/1I/3 

-k{y2 - X2) 

X3 = X1X2 - P3X3 m = yiy2 - qsys 

with pi = 10, P2 = 28 and = 8/3. The six equations (8), together with four equations 
(Eqs. (6) and (7)) for estimation of each of the three parameters results in a set of eighteen 
equations, governing the evolution of the (i) simulated experimental system, (ii) model 
system, (iii) parameters and (iv) the variational derivatives. When p = q, the feedback 
term corresponding to the product of the constant vector B = [0, 1, 0]^, suitable gain K = 
[0, k, 0]^ and the output error {y2—X2) guarantees synchronization of the model system with 
the experimental system. We consider the situation where additive uniformly distributed 
random noise in the range [—0.5, 0.5] is present in the measured output X2- Figure 1 shows the 
evolution of the parameters and the relative estimation errors for the case where in addition 
to noise, a step perturbation in parameters is imposed on the simulated experimental system. 
It is important to note that this introduces an additional complexity since information about 
the imposed perturbation is not available to the model. The robustness of the method is 
demonstrated by the convergence to the original parameters close to t = 125; followed by a 
rapid, stable transition and subsequent convergence into the vicinity of the new operating 
parameters. All parameters could be successfully determined when the measured output was 
the Xi variable. However, the method fails when the measured output is the X3 variable, 
since the Lyapunov exponents of Eq. (3) are not negative for any choice of B and K. 

Our next example is the Rossler system and we demonstrate the method when the scalar 
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observable is x^- The simulated experimental and model system equations are given by 



±1 = -X2 - X2) vi = -y2 - 

±2 = X1+P1X2 y2 = yi + qm , . 

-k{y2 - X2) 
X3 = P2 + X3{xi - Pa) = 52 + ysiyi - qs) 

with pi = 0.2, P2 = 0.2 and p^ = 9. The feedback parameter vectors were selected to be 
B — [0, 1, 0]"^ and K = [0, k, 0]^. Results for two different cases arc shown in Fig. 2. These 
correspond to the situation when (i) additive uniformly distributed random noise in the 
range [—0.1,0.1] is present in the measured output [Fig. 2(a)] and (ii) in addition to noise, 
the parameters of the simulated experimental system are increased by 10% Bit t — 500 [Fig. 
2(b)]. For both cases, the parameter estimates exhibit small-amplitude fluctuations around 
the correct value. The nature of evolution of errors in Fig. 2(b) indicates that the step 
perturbation results in a rapid transition of the parameter estimates into the vicinity of the 
new value. A feature of this result is the direct dependence of the magnitude of fluctuations 
of individual parameters on the manner in which the parameter is related to the measured 
output. 

The next example is a four parameter Rossler hyperchaos system. The simulated exper- 
imental and model systems are given by the following equations 

xi = -X2 -X3 yi = -y2 - yz 

±2 ^ xi^ P1X2 + X4 y2 ^ yi + qm + y4-w ^^^^ 

^3 = P2 + xixs m = q2 + vm 

XA = -P3X3 + P4X4 ijA = -qsys + 542/4 - w 

with Pi — 0.25, p2 — 3, ps — 0.5 and p4 — 0.05. The measurable output is assumed to be 
s(x) — X2 + X4, w — k{s{y) — s(x)), B = [0,1,0,1]^ and K = [0, /c, 0, /c]^. It is possible 
to achieve identical synchronization for this system using uni-directional coupling and a 
suitable choice of K. We study the ability of the method to track changes in operating 
parameters of the simulated experimental system. It is assumed that parameters pi and p2 
of the simulated experimental system are increased by 4% at t — 500. The scaled temporal 
evolution of all the estimated parameters g^, i = 1, ■ • ■ , 4 is shown in Fig. 3(a). Figure 3(b) 
shows the evolution of the estimated parameters for the case when in addition to changes in 
operating parameters of the simulated experimental system, uniformly distributed random 
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noise in the range [—0.005, 0.005] is present in the experimental measured output. For 
each case, it can be seen that the method allows a rapid convergence to the new operating 
parameters. 

Finally, we present a simple example to illustrate a possible application of the proposed 
parameter estimation scheme in communications using chaos. The problem relates to decod- 
ing of an encoded message signal. It is assumed that the following information is known: (i) 
the chaotic system used to encode the message, and (ii) the state variable used for encoding 
the message. For simplicity, the message is taken to be a sinusoidal function, and it is as- 
sumed that the encoding is carried out in an additive manner. The objective is to decode the 
noisy transmitted signal and retrieve the message. The first step in achieving this objective 
is to estimate the parameters of the model system. Once this has been accomplished, the 
message can be retrieved by subtracting the computed model output from the transmitted 
signal. Figure 4 shows the fair degree of comparison between the message signal and the 
decoded signal estimated using the Lorenz and Rossler systems for the case when additive 
noise in the range [—0.1, 0.1] is also present in the transmitted signal. 

In conclusion, we have developed an analytical framework for the robust design of dy- 
namical systems that guarantees online estimation of all model parameters of a given 
chaotic/hyperchaotic system when certain conditions are satisfied. The key advantage of 
the proposed technique is that it requires information of only a scalar measured output from 
the experimental system. A possible application in communications using chaos has been 
demonstrated. We have verified that the method proposed here would be apphcable to the 
more realistic situation where only discrete-time measurements of the experimental output 
are available [8]. These results will be communicated in the future. 
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FIGURE 1 Temporal evolution of (a) all the three parameters of the Lorenz system, (b) 
fractional relative errors for the case when additive noise is present in the measured output 
and the parameters of the simulated experimental system are changed to pi — 11, p2 — S5 
and p3 = 3 at t = 150. The stability parameters are k — 25, ei — 1, 62 = 15 and 63 = 1. 
The straight lines in (b) correspond to an error of ±5%. 

FIGURE 2 Temporal evolution of the estimation errors for all the parameters of 
the Rossler system (9) for the case when (a) only additive noise is present in the measured 
output X2, (b) additive noise is present and each of the parameters of the simulated 
experimental system is increased by 10% at t — 500. The parameter has been scaled 

down 50 times for greater clarity of representation. The stability parameters are k = 20, 
ei = 0.15, 62 = 0.2 and £3 = 2. The straight lines correspond to an error of ±5%. 

FIGURE 3 Temporal evolution of the four parameters gi, q2, qs and q4 of the Rossler 
hyperchaos system (10) for the case when (a) the parameters pi and p2 are increased by 4% 
at t — 500, (b) additive noise is present in the measured output X2 + X4,, and the parameters 
Pi and P2 of the simulated experimental system are increased by 4% at t = 300. For greater 
clarity of representation, the parameters have been scaled in the following manner: 52 and 
qs are scaled down 10 and | times respectively, while the parameter q4 is scaled up 4 times. 
The stabihty parameters are (a) k — A, €1 — 0.75 and €2 — €3 — €4 — 0.005; (b) k — 3.5, 
ei = 0.80 and 62 = 63 = 64 = 0.002. 

FIGURE 4 Comparison of the message signal / = sin(207rt) and the decoded sig- 
nals obtained using the X2 variable of Lorenz and Rossler models as the measured output. 
These are represented by the continuous, dashed and dotted lines respectively. Decoding 
results in phase shift as well as in a reduction of the amplitude. The amplitude of the 
message signal has been scaled for greater clarity. The stabihty parameters are the same as 
that given in Fig. 1 and Fig. 2. 



9 




Time Time 

FIG. 1: Temporal evolution of (a) all the three parameters of the Lorenz system, (b) fractional 
relative errors for the case when additive noise is present in the measured output and the parameters 
of the simulated experimental system are changed to = 11, p2 = 35 and ps = 3 at t = 150. The 
stability parameters are A; = 25, ei = 1, 62 = 15 and 63 = 1. The straight lines in (b) correspond 
to an error of ±5%. 
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FIG. 2: Temporal evolution of the estimation errors for all the parameters of the Rossler system (9) 
for the case when (a) only additive noise is present in the measured output X2, (b) additive noise 
is present and each of the parameters of the simulated experimental system is increased by 10% 
dX t = 500. The parameter ^3 has been scaled down 50 times for greater clarity of representation. 
The stability parameters are k = 20, ei = 0.15, 62 = 0.2 and es = 2. The straight lines correspond 
to an error of ±5%. 
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FIG. 3: Temporal evolution of the four parameters gi, q2-, gs and g4 of the Rossler hyperchaos system 
(10) for the case when (a) the parameters pi and p2 are increased by 4% at t = 500, (b) additive 
noise is present in the measured output X2 + a;4, and the parameters p\ and p2 of the simulated 
experimental system are increased by 4% at t = 300. For greater clarity of representation, the 
parameters have been scaled in the following manner: q2 and qz are scaled down 10 and | times 
respectively, while the parameter q^ is scaled up 4 times. The stability parameters are (a) k = 4, 
ei = 0.75 and €2 = 63 = 64 = 0.005; (b) k = 3.5, ei = 0.80 and €2 = 63 = 64 = 0.002. 
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FIG. 4: Comparison of the message signal / = sin(207ri) and the decoded signals obtained using 
the X2 variable of Lorenz and Rossler models as the measured output. These are represented by 
the continuous, dashed and dotted lines respectively. Decoding results in phase shift as well as 
in a reduction of the amplitude. The amplitude of the message signal has been scaled for greater 
clarity. The stability parameters are the same as that given in Fig. 1 and Fig. 2. 
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